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Abstract 

Low-cost sensing gloves for reconstruction posture provide measurements which 
are limited under several regards. They are generated through an imperfectly 
known model, are subject to noise, and may be less than the number of Degrees 
of Freedom (DoFs) of the hand. Under these conditions, direct reconstruction 

Oof the hand posture is an ill-posed problem, and performance can be very poor. 
This paper examines the problem of estimating the posture of a human hand us- 
Ph ing (low-cost) sensing gloves, and how to improve their performance by exploiting 

the knowledge on how humans most frequently use their hands. To increase the 
O accuracy of pose reconstruction without modifying the glove hardware — hence 

basically at no extra cost — we propose to collect, organize, and exploit informa- 
I tion on the probabilistic distribution of human hand poses in common tasks. We 

^ discuss how a database of such an a priori information can be built, represented in 

sl hierarchy of correlation patterns or postural synergies, and fused with glove data 
if) in a consistent way, so as to provide a good hand pose reconstruction in spite of in- 

lO sufficient and inaccurate sensing data. Simulations and experiments on a low-cost 

glove are reported which demonstrate the effectiveness of the proposed techniques. 

(N 1 Introduction 

In recent years numerous studies have underlined the complex role of human hand 
j ' i— j in motor organization, with particular attention to grasping. It was shown that indi- 

viduated finger motions were phylogenetically superimposed on basic grasping move- 
^ ments [Gordon, 2001) . Moreover, it is possible to individuate a reduced number of 

coordination patterns (synergies) which constrain both joint motions and force exer- 
tions of multiple fingers [Schieber and Santell o72004| |. These constraints can be re- 
lated to both biomechanics factors IFahrer, 19811 and synchronization between dif- 
ferent motor units [Kilbreath and Gan devia, 2002) . Coordination patterns were ana- 
lyzed by means of multivariate statistical methods over a grasping data set, reveal- 
ing that a limited amount of so-called eigenpostures or principal components (PCs) 
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[Mason et al., 20 01], or otherwise "statistically identified kinematic coordination pat- 
terns" [Schieber and Santello, 2004 ], are sufficient to explain a great part of hand pose 
variability. In addition, a gradient in eigenpostures was identified [ Sant ello et al., 19981 , 
showing that lower order PCs take into account covariation patterns for metacarpopha- 
langeal (MCP) and interphalangeal (IP) joints, which are mainly responsible for coarse 
hand opening and closing, while higher order PCs are used for fine hand shape adjust- 
ments. 

These studies and results on human hand in grasping tasks suggest that there exist 
some inner hand representations of increasing complexity, which allow to reduce the 
number of Degrees of Freedom (DoFs) to be used according to the desired level of 
approximation. From a controllability point of view, this idea was then adopted in 
robotics to define simplified approaches for the design and control of artificial hands 
IBicchi, 20001 |Brown and Asada, 20071 . 

On the other hand, from the observability point of view, this fact also suggests 
that it is possible to reduce the number of independent DoFs to be measured in order 
to obtained the hand pose estimation for a given level of approximation. An appli- 
cation of this concept was developed in [Mula tto et al., 2 010] for hand avatar anima- 
tion. In this paper, we exploit the information embedded in a known grasp set, which 
expresses the postural constraints for multi-finger joints, to improve the reconstruc- 
tion of the hand posture in static grasping tasks when only a limited and inaccurate 
number of measures are available by low-cost sensing gloves for gesture measure- 
ment ISturman and Zeltzer, 19941 , [ [Dipietro et al., 2008| . "Glove-based" devices or 
"sensing gloves", i.e. devices for hand pose reconstruction based on measurements 
of few geometric features of the hand, provide useful interfaces for human-machine 
and haptic interaction in many fields like, for example, virtual reality, musical perfor- 
mance, video games, teleoperation and robotics |Pao and Speeter, 1989) . However, the 
widespread commercialization of electronic gloves imposes limits on the production 
costs in terms of the amount and the quality of the sensors adopted. As a consequence, 
the correctness of the hand pose reconstruction obtained by these devices might be 
compromised. 

The objective of this paper and its companion [Bianch fet al., 20 12a) is to provide 
new tools to improve the design and performance of sensing gloves by exploiting the 
knowledge on how humans most frequently use their hands. 

In this paper, partially based on [Bianchi et al., 201 2b], the aim is to provide hand 
pose estimation technique based on B ayes 'inference which optimizes the performance 
for a given glove design. Two different approaches have been followed to achieve this 
goal. The first one solves a constrained optimization problem of multinormal proba- 
bility density function (pdf), and it is mainly suited when accurately measured data is 
available. The second approach deals with noisy measured data and relies on classic 
Minimum Variance Estimation (MVE). To validate these methods we consider mea- 
surements from a set of grasp postures acquired with a low cost sensing glove and 
compare the achieved hand pose reconstruction with reference measures provided by a 
very accurate optical tracking system. Effects of noise are also taken into account and 
new simulations w.r.t. [Bianc hTet al., 20 12b) have been conducted. Statistical analyses 
of both experimental and simulation results demonstrate the effectiveness of the here 
proposed procedures. 



In (Bianchi et al., 2012a], we consider the dual problem of optimal design of pose 
sensing gloves, based on a suitable cost function which combines the a priori informa- 
tion and measures. Simulations are reported where the estimation procedures described 
in this paper are applied to the measures provided by the optimally designed glove. We 
first consider the case that individual sensing elements in the glove can be designed 
so as to measure a linear combination of joint angles, and provide, for given a priori 
information and fixed number of measurements, the optimal design minimizing in av- 
erage the reconstruction error. We then discuss the case that only single-DoF sensors 
are used in the glove. Finally an hybrid design which combines continuous and discrete 
measures and expresses a trade-off between quality and feasibility is proposed. 



2 The hand posture estimation algorithm 

Let us consider a set of measures y £ ]R m given by a sensing glove. By using a n degree 
of freedom kinematic hand model, we shall assume a linear relationship between joint 
variables x £ 1R/ 2 and measurements y given by 

y = Hx+v, (1) 

where H £ ]R mxn (m < n) is a full rank matrix which represents the relationship be- 
tween measures and joint angles, and v £ ]R m is a vector of measurement noise. The 
goal is to determine the hand posture, i.e. the joint angles x, by using a set of mea- 
sures y whose number is lower than the number of DoFs describing the kinematic hand 
model in use. Equation ([]]) represents a system where there are fewer equations than 
unknowns and hence is compatible with an infinite number of solutions, described 
e.g. as 

x = rfy+N h $, (2) 

where is the pseudo-inverse of matrix H, Nh is the null space basis of matrix H 
and ^ £ ]R( n-m ) is a free vector of parameters. Among these possible solutions, the 
least-squared solution resulting from the pseudo-inverse of matrix H for system ([]} is 
a vector of minimum Euclidean norm given by 

x = H^y. (3) 

However, the hand pose reconstruction resulting from ([3]) can be very far from the 
real one. The purpose of this paper is to improve on the accuracy of the pose recon- 
struction, choosing, among the possible solution to ([2]), the most likely hand pose. The 
basic idea is to exploit the fact that human hands, although very complex and possi- 
bly different in size and shape, share many commonalities in how they are shaped and 
used in frequent everyday tasks. Indeed, studies on the human hand in grasping tasks 
showed that finger motions are strongly correlated according to some coordination pat- 
terns referred to as synergies in [Sante llo et al., 1998] . 

In this paper, we show how to improve hand pose reconstruction by exploiting the 
a priori information obtained by collecting a large number N of grasp postures 



consisting of n DoFs, into a matrix X G R nxiV . This information can be summarized in 
a covariance matrix P Q £ R wx ", which is a symmetric matrix computed as 

_ (X-x)(X-x) T 

*0 — 



N-l 

where x is a matrix nxA^ whose columns contain the mean values for each joint angle 
arranged in vector ji G ]R n . 

2.1 Probability Density Function Maximization 

In this section, we initially consider the case that measurement noise is negligible. The 
hand pose estimation can be improved w.r.t. that obtained by ([3J, by exploiting the a 
priori information, that we will assume to be a multivariate normal distribution, on 
a set of grasping poses built beforehand and embedded in the covariance matrix P . 
The best estimation of the hand posture is given by choosing as optimality criterion 
the maximization of the probability density function (pdf) of a multivariate normal 
distribution, expressed by ([Tarantola, 2005 ]) 

/(*) = J,^ exp I - \ ^ - Vo) T P^\x -VjY (4) 

V 27l W P o\\ I 2 J 

This is equivalent to solving the following optimal problem: 

{x = argmin Ux- Ho) T Po l ( x ~ Ho) 
* (5) 
Subject to y = Hx. 

It is interesting to give a geometrical interpretation of the cost function in ([5]), which 
expresses the square of the Mahalanobis distance [Mahalanobis, 1936 ]. The concept of 
Mahalanobis distance, which takes into account data covariance structure, is widely ex- 
ploited in statistics, e.g. in PC Analysis, mainly for outlier detection [Hawkins, 1980]. 
Accordingly, to assess if a test point belongs to a known data set, whose distribution 
defines an hyper-ellipsoid, we take into account both its closeness to the centroid of 
data set and the direction of the test point w.r.t. the centroid itself. In other words, 
the more samples are distributed along this direction, the more probably the test point 
belongs to the data set even if it is further from the center. 

Taking into account ([2]), the optimal problem defined in §5§ becomes 

'I = zrgmmirfy + NhZ-frf^iHiy + NhZ-fr) 

I (6) 
Subject to y = Hx. 

By using classic optimization procedures we obtain ^ = (N^P~ l Nh)~ l N^P~ l (fl — 
H^y) and, substituting in ([2]), after some algebras, the estimation of the hand joint 
angles is 

i = [I-N h (Nlp- 1 N h )- l NlP - l }H^y+ 

+N h (N T h p; l N h )- l N T h p; l Vo. (7) 



Problem §5§ can be also solved through the method of Lagrange multipliers. Intro- 
duce a new variable A G ]R m and consider 

L = \ (x - Lio/Po 1 (x ~ lie) +X T (Hx-y). (8) 

By imposing |^ = |£ = 0, we have 

Jc = Mo " (HP H T )-\Hii - y) . (9) 

This solution can be easily shown to be equivalent to ([7]). 

Finally, it is interesting to observe that the least- squared and pdf maximization 
methods have a direct application in case of only single-DoF sensors are used in the 
devices (discrete sensing gloves). In this case, H is a selection matrix whose rows are 
vectors of the canonical basis in and the least- squared solution is simply given as 
x = H T y. In order to improve the hand pose reconstruction by the a priori information, 
it is possible to easily maximize E[x\y] in terms of multinormal conditional distribu- 
tion [Hardle and Simar, 2 007]. Indeed, in this case vector y defines a precise subset 
of the state variables, being X\, whose values are known by means the measurement 
process, while X 2 indicates the rest of state variables to be estimated. This definition 
allows to partition the a priori covariance matrix as 

as well as the a priori mean ji = {ji \ \jioi)- The estimation of X2 is easily derived as 
X 2 =E[X 2 \X 1 =y]=Li o2 + P o21 p-\(y-iiol)- (11) 



2.2 Minimum Variance Estimation 

Results in previous section are valid in the condition of v ~ 0. When noise is not 
negligible, the role of a priori is more emphasized. 

In this section we propose an algorithm based on the Minimum Variance Estima- 
tion (MVE) technique. This method minimizes a cost functional which expresses the 
weighted Euclidean norm of deviations, i.e. cost functional / = J x (x — x) T S(x — x)dx, 
where S is an arbitrary, semidefinite positive matrix. 

Under the hypothesis that V has zero mean and Gaussian distribution with covari- 
ance matrix R, we get the solution for the minimization of / as x = E [x\y] , where E [x\y] 
represents the a posteriori pdf expectation value. The estimation x can be obtained as 
in IGelb, 1974) by 

x=(p- l +H T R- l H)-\H T R- l y + p- l ilo), (12) 

where matrix P p = (P~ l + H T R~ l H)~ l is the a posteriori covariance matrix, which 
has to be minimized to increase information about the system. This result represents a 
very common procedure in applied optimal estimation when there is redundant sensor 



information. In under-determined problems, it is only thanks to the a priori informa- 
tion, represented by P Q and jl , that equation ( fT2| ) can be applied (indeed, H T R~ l H is 
not invertible). 

When R tends to assume very small values, the solution described in equation 
(Y2\ might encounter numerical problems. However, by using the Sherman-Morrison- 
Woodbury formulae, 

(P- 1 +H T R- 1 H)- 1 =P -P H T (HP H T +R)- 1 HP (13) 
(P~ l +H T R~ l H)- l H T R~ l = P H T (HP H T , (14) 

equation ( fT2| ) can be rewritten as 

x = [i -P H T (HP H T +R)-\Hilo ~y) , (15) 

and the a posteriori co variance matrix becomes P p = P — P H T (HP H T +R)~ l HP 
(cf. fl3])). By placing R = in fl5] ), we obtain equation ^ and the a posteriori covari- 
ance matrix becomes 

P p =P -P H T (HP H T y l HP . (16) 

Notice that probability density function maximization approach is a peculiar case 
of the here described MVE technique. For this reason in the following sections we 
will always refer to the reconstruction technique as MVE for both noise-free and noisy 
measures and we will use fj"5] ) with R = or R ^ 0, respectively. 



3 Model and Data capture 

Without loss of generality, for hand pose reconstruction we adopt the 15 DoFs model 
also used in [Santell o et al., 19 98 , Gab iccini and Bicchi, 2 010] and reported in figure[T] 
A large number of static grasp positions were collected using 19 active markers and an 
optical motion capture system (Phase Space, San Leandro, CA - USA). More specifi- 
cally, all the grasps of the 57 imagined objects described in [ Sant ello et al., 1998] were 
performed twice by subject AT (M,26), in order to define a set of 1 14 a priori data. 
Moreover, 54 grasp poses of a wide range of different imagined objects were executed 
by subject LC (M,26)[] These data is recorded in parallel with the sensing glove and 
the Phase Space system, to achieve both a glove calibration and reliable reference val- 
ues for whole hand configurations. Indeed, we can consider the processed hand poses 
acquired with Phase Space as a good approximation of real hand positions, given the 
high accuracy provided by this optical system to detect markers (the amount of static 
marker jitter is inferior than 0.5 mm, usually 0.1 mm) and assuming a linear correlation 
(due to skin stretch) between marker motion around the axes of rotation of the joint and 
the movement of the joint itself [Zhan g et al., 20 03]. Since the sensing glove perfectly 



adapts to subject hand shape when it is worn, the latter assumption is still reasonable 
also in this case. None of the subjects had physical limitations that would affect the ex- 
perimental outcomes. Data collection from subjects in this study was approved by the 
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Figure 1: Kinematic model of the hand with 15 DoFs. Markers are reported as red 
spheres. 




Figure 2: The sensing glove (on the left) and sensing glove with added markers (on the 
right). 



University of Pisa Institutional Review Board. Markers are placed on the glove refer- 
ring to | |Fu and Santello, 2010) , see figure [2] Four markers are used for the thumb and 
three markers for each of the rest of the fingers. Additional three markers placed on the 
dorsal surface of the palm defines a local reference system Markers are sampled at 
480 Hz and their positions are given referring to the global reference system Smc, as it 
is defined during the calibration phase of the acquisition system (cf. figure [T]). 

Joint angles are computed w.r.t. Sh by means the ikine function of Matlab Kine- 
matic Toolbox. This function implements an iterative algorithm of kinematic inversion, 
which has been suitably modified by adapting computational tolerance to guarantee nu- 
merical convergence. A moving average filter is exploited for data pre- filtering, thus 
enhancing Signal Noise Ratio (SNR). As a preliminary phase, the hand is posed in a 



These hand posture acquisitions are available at http://handcorpus.org/ 



reference position, where fingers flexion-extension is nearly zero, and phalanx length 
and eventual offset angles are computed. 

Normality assumption on the acquired a priori set is tested by means of a Q-Q 
plot-based graphical method for multidimensional variables [Cham bers et al., 1983[ 
|Holgersson, 2006| . The quantile plot is usually obtained by plotting the ordered es- 
timated Mahalanobis measures against the chi-square distribution quantiles. If normal- 
ity is met, the graph should display a fairly straight line on the diagonal (i.e. 45° slope 
line). In our case, the linear fitting with straight 45° slope line provides an adjusted r- 
squared coefficient of 0.6. This result suggests that the normality assumption is reason- 
able even if not fully met. However, the Gauss-Markov theorem [Rao , 1973| ensures, 
that the MVE is the Best Linear Unbiased Estimate (BLUE) in the minimum- variance 
sense even for non-Gaussian a priori distributions [Bicchi and Canep a~994[ . In ad- 
dition, central limit theorem [Hardle and Simar, 2007) can guarantee, to some extents, 
the application of MVE method to cases that depart from the strict linear- Gaussian 
hypothesis for a priori distribution (and noise distribution as well). 

4 Simulation Results 

We simulate an ideal glove which is able to measure only metacarpal joints by using 
the acquisitions obtained with Phase Space. The measurement matrix for this simu- 
lated glove will be referred as H s . Estimation results obtained with our algorithms are 
compared with the corresponding reference values. An additional random Gaussian 
noise with standard deviation of 7° is considered on each measurement. This value is 
chosen in a cautionary manner, based on data about common technologies and tools 
used to measure hand joints positions [Simon e et al., 20071 . More specifically, this 
value expresses the reliability threshold of manual goniometry with skilled therapists 
in measures for rehabilitation procedures [ Wis e et al., 1 990]. 

The estimation performance is evaluated in terms of estimation errors. Pose estima- 
tion errors (i.e. the mean of DoF absolute estimation errors computed for each pose), 
and DoF absolute estimation errors are considered and averaged over all the number 
of reconstructed poses. We perform these two types of analysis in order to furnish a 
more clear result comprehension. Indeed, pose estimation errors provide an useful but 
only global indication about the technique outcomes, potentially leading to some bi- 
ased observations. For example, we might obtain a hand pose reconstruction with all 
the fingers in a "slightly right" position producing the same average error of a hand 
pose reconstruction with all the fingers but one in the right position and the one mispo- 
sitioned very distant from the real one. Therefore, to overcome this limitation we also 
analyze each DoF estimation accuracy. In addition, some reconstructed poses are dis- 
played w.r.t the reference ones, to provide a qualitative representation mainly focused 
on reconstruction likelihood exhibited by reconstructed poses with common grasp pos- 
tures. Statistical differences between estimated pose and joint errors obtained with 
above described techniques are computed by using classic tools, after having tested for 
normality and homogeneity of variances assumption on samples (through Lilliefors' 
composite goodness-of-fit test and Levene's test, respectively). Standard two-tailed 
t-test (hereinafter referred as T e q ) is used in case of both the assumptions are met, a 



modified two-tailed T-test is exploited (Behrens-Fisher problem, using Satterthwaite's 
approximation for the effective degrees of freedom, hereinafter referred as T neq ) when 
variance assumption is not verified and finally a non parametric test is adopted for the 
comparison (Mann-Whitney U-test, hereinafter referred as U ) when normality hypoth- 
esis fails. Significance level of 5% is assumed and p-values less than 10 -4 are posed 
equal to zero. 

In case of noise free measurements, mean absolute pose error obtained with MVE 
is 6.69 ± 2.38°, while with Pinv it is equal to 13.89 ± 3.09°, with observed statistical 
difference between the two methods (p ~ 0, T eq ). What is noticeable is that MVE 
provides a better pose estimate than the one obtained using Pinv in terms of both mean 
pose absolute estimate error and considering maximum absolute pose estimation error 
(MVE: 13.18° vs. Pinv: 20.82°). 

In case of noisy measurements, mean absolute pose estimation error with MVE 
is 8.52 ±2.86°, while with Pinv we get 15.71 ±3.08°. Also in this case statistical 
difference is observed between MVE and Pinv (p ~ 0, T neq ). Notice that MVE still 
provides the best pose estimate and the smallest pose absolute maximum error (MVE: 
(17.14° vs. Pinv: 23.39°). 

In table [T] absolute average estimation errors for each DoF with their corresponding 
standard deviations are reported for MVE and Pinv procedures. Noise-free measures 
are considered. Significant statistical differences between the two techniques are found 
considering estimation errors for all DoFs, except for those directly measured and for 
TA and TI. The latter ones refer to thumb finger; this fact might be partially explained 
by the difficulties in modeling thumb phalanges under a kinematic point of view. MVE 
exhibits an estimation performance in terms of mean error which is better or not sta- 
tistically different from the one achieved by Pinv, except for I A DoF; however, in this 
case the difference between the mean errors for the two methods is the smallest (less 
than 6°) among all the differences computed for the significantly different estimated 
DoFs. MVE provides the smallest maximum errors except for I A DoF; however the 
difference with maximum error obtained using Pinv is less than 12°. This difficulty 
in estimating IA DoF might be partially explained in terms of the variability in con- 
trolling index abduction, which can lead to slightly different position w.r.t the ones 
resulting from the a priori set. In table [2] values of each DoF estimation absolute error 
averaged over all poses, with their corresponding standard deviations, are reported in 
case of noise. Maximum errors are calculated and statistical significance in result com- 
parison for each DoF estimation, between the aforementioned techniques, is indicated 
in table [2] Notice that MVE furnishes the best performance with average estimation 
errors which are always inferior or not statistically different from the ones obtained 
using Pinv algorithm, except for IA DoF for which Pinv produces the smallest average 
estimation error. However, the difference between IA mean errors calculated with the 
two procedures is less than 3°. No statistically significant difference are found between 
MVE and Pinv for TI, IM, MM, RM and LM DoFs. Notice that the DoFs for which no 
statistical difference is observed between MVE and Pinv are DoFs directly measured or 
they refer to thumb finger phalanx. This fact may be partially explained in terms of the 
difficulties in thumb phalanges modeling under a kinematic point of view as previously 
mentioned. Considering maximum errors, MVE still exhibits the best results, except 
for IA DoF. 
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Table 1: Average estimation errors and standard deviations for each DoF [°] for the 
simulated acquisitions without noise. MVE and Pinv methods are considered. Maxi- 
mum errors are also reported as well as p-values from the evaluation of DoF estimation 
errors between MVE and Pinv. A color map describing p-values is also added to sim- 
plify result visualization, o indicates that T eq test is exploited for the comparison. % 
indicates a T ne q test. When no symbol appears near the tabulated values, it means that 
U test is used. Bold value indicates no statistical difference between the two methods 
under analysis at 5% significance level. When the difference is significative, values are 
reported with a 10 -4 precision, p-values less than 10 -4 are considered equal to zero. 

In figure [3] some reconstructed poses are displayed in comparison with their corre- 
sponding reference values achieved with Phase Space System, with and without noise. 
Notice that MVE qualitatively shows the best reconstruction results, thus maintain- 
ing, unlike Pinv, the likelihood with common grasping poses because of the a priori 
information. 

5 Experimental Results 

We test for the effectiveness of our reconstruction procedure using a sensorized glove 
based on Conductive Elastomer (CE). CE strip are printed on a Lycra® /cotton fabric 
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Table 2: Average estimation errors and standard deviations for each DoF [°] for the 
simulated acquisitions with noise. MVE and Pinv methods are considered. Maximum 
errors are also reported as well as p-values from the evaluation of DoF estimation er- 
rors between MVE and Pinv. A color map describing p-values is also added to simplify 
result visualization, o indicates that T eq test is exploited for the comparison. % indi- 
cates a T neq test. When no symbol appears near the tabulated values, it means that U 
test is used. Bold value indicates no statistical difference between the two methods 
under analysis at 5% significance level. When the difference is significative, values are 
reported with a 10 -4 precision, p-values less than 10 -4 are considered equal to zero. 

in order to follow the contour of the hand, see figure [2] Connection to 20 different 
sensor segments of the polymeric strip is realized using additional conductive elastomer 
elements printed on the dorsal side of the glove [ Togne tti et al., 2 006]. 

Since CE materials present piezoresistive characteristics, sensor elements corre- 
sponding to different segments of the contour of the hand length change as the hand 
moves. These movements cause variations in the electrical properties of the material, 
which can be revealed by reading the voltage drop across such segments. The sensors 
are connected in series thus forming a single sensor line while the connections intersect 
the sensor line in the appropriate points. An ad hoc electronic front-end was designed 
to compensate the resistance variation of the connections, made by the same material 
of the sensors, using an high input impedance stage. 
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Figure 3: Hand pose reconstructions with Pinv and MVE algorithms by using a selec- 
tion matrix H s which allows to measure TM, IM, MM, RM and LM (see figure [T]). In 
color the "real" hand posture whereas in white the estimated one. 



Data coming from the front-end is then low pass filtered, digitalized and acquired 
by means of a general purpose DAQ card, and finally elaborated on a computer. 

This glove can be considered as a continuous sensing device as it will be more 
clearly described in [ Bianchi et al., 201 2a] since each sensor consists of a single sens- 
ing line all over different joints. However, data processing is based on the assumption 
that changes in the electrical characteristics of the sensor elements, corresponding to 
different segments of the contour of the hand, are associated with changes in the an- 
gle of the joint such sensor elements cut across. Furthermore, it was assumed that the 
hand aperture linearly relates to changes in the electrical characteristics of the sensor 
elements occurring as joint angles change. Considering this, a function that map the 
sensor raw data to joint angles was designed. Therefore, a linear regression model 



having hand aperture as dependent variable and the output of the sensor elements as 
independent variables was built. Fitting of the model was achieved using a calibration 
phase. Subjects were instructed to perform two fixed hand gesture, flat and grip, cor- 
responding respectively to the minimum and maximum elongation of sensor's length. 
In the present study, long finger flexion-extension recognition is obtained by means 
of an updated multi-regressive model having the metacarpophalangeal (MCP) flexion- 
extension angles of the five long fingers as dependent variables and the outputs of CE 
sensor covering MCP joints as independent ones. According to the hand kinematic 
model adopted in this work they are referred as to TM, IM, MM, RM, LM. The model 
parameters are identified by measuring the sensor status in two different positions: 
(1) hand totally closed (90 degrees), (2) hand totally opened (0 degrees). For a more 
complete description of the aforementioned processing techniques as well as the glove 
design see e.g. ILorussi et al„ 20041 [Tbgnetti et al„ 2007HTognetti et al„ 2008) . 

This sensorized glove represents one of the most recent and inexpensive envision 
in glove device literature. However, this solution is limited by some factors, e.g. cloth 
support which affects measurement repeatability as well as hysteresis and non linear- 
ities due to piezoresistive material properties. Moreover, the assumptions done for 
data processing (the relationship between joint angle and sensors as well the linearity 
between hand aperture and electrical property changes) as well the calibration phase, 
which is based only on two-point fitting, can act like potential sources of errors. To 
overcome the latter point a new calibration is performed to estimate the measurement 
matrix, as it is described in the next section. 



5.1 Results and Discussion 

Firstly we have obtained an estimation of the measurement matrix of the glove H g . For 
this purpose, a calibration phase was performed by collecting a number of poses N in 
parallel with the glove and the position optical tracking system. This number has to be 
larger or equal than the dimension of the state to estimate, i.e. N > 15. X g G R 15x15 
collects the reference poses, while matrix Y g G R 5x15 organizes the measures from the 
glove. These measures represent the values of the signals referred to measured joints, 
averaged over the last 50 acquired samples. For the acquisition a DAQ card which 
works at 250 kS/s (NI PCI-6024E by National Instruments, Austin, Texas, USA) has 
been used within Matlab Simulink® environment. 

An estimation H g of the measurement matrix can be obtained by using the relation 
Y g H g X g as 

H g = Y g ((X^) T . (17) 

We characterize measurement noise in terms of fluctuations w.r.t. the aforemen- 
tioned average values of the measures, thus obtaining noise covariance matrix R. Noise 
level is less than 10% measurement amplitude, however we might obtain consistent er- 
rors in the measurement matrix estimation due to intrinsic non-linearities and hysteresis 
of glove sensing elements. 

The average absolute pose estimation error with MVE is 10.94 ±4.24°, while it 
is equal to 19.00 ± 3.66° by using Pinv. Statistical difference is observed between the 
two techniques (p = 0, T eq ). Notice that MVE exhibits the best pose reconstruction 
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* indicates a measured DoF. 

Table 3: Average estimation errors and standard deviations for each DoF [°], for the 
sensing glove acquisitions. MVE and Pinv methods are considered. Maximum errors 
are also reported as well as p-values from the evaluation of DoF estimation errors 
between MVE and Pinv. A color map describing p-values is also added to simplify 
result visualization, o indicates that T eq test has been exploited for the comparison. % 
indicates a T ne q test. When no symbol appears near the tabulated values, it means that 
U test has been used. Bold value indicates no statistical difference between the two 
methods under analysis at 5% significance level. When the difference is significative, 
values are reported with a 10 -4 precision, p-values less than 10 -4 are considered equal 
to zero. 

performances also in terms of maximum errors (25.18 ° for MVE vs. 30.30 ° for 
Pinv). Absolute average reconstruction errors for each DoF are reported in table [3] 
MVE produces smaller mean errors than those obtained with Pinv with statistical dif- 
ference w.r.t. Pinv algorithm, see table [3j except, respectively, for those DoFs which 
are directly measured (i.e. IM, RM and LM), for RA DoF, which exhibits a limited 
average estimation error (« 6°), and finally TA. For TI the smallest average estimation 
is observed with Pinv; a possible explanation for this might be still related to the dif- 
ficulties behaviour related to thumb phalanx modeling (as also observed in section [3] 
for TA DoF) can be explained considering the simplifications adopted in our kinematic 
model for modeling the complexity of thumb phalanx (as observed also in Section [3] 
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Figure 4: Hand pose reconstructions with Pinv and MVE algorithms, with measures 
given by sensing glove. In blue the "real" hand posture whereas in white the estimated 
one. 



for TA DoF). IA DoF presents the smallest absolute average estimation error with Pinv, 
although p- values from the comparisons between the two techniques for the estimation 
of this DoF are close to the significance threshold. All these observations are coherent 
with the discussions developed in Section [3] 

Maximum DoF reconstruction errors for MVE are observed especially for those 
measured DoFs with potentially maximum variations in grasping tasks; this fact may be 
probably interpreted considering the non linearities in sensing glove elements leading 
to inaccurate estimation of H g , hence to inaccurate measures. 

Finally, except for some singular poses, the best estimation performance is pro- 
vided by MVE for which a good robustness to errors in measurement process model- 
ing is also observed. However, the latter errors have not been taken numerically into 
account in our analyses. Moreover, as it can been seen in figure |4j reconstructed hand 
configurations obtained by MVE preserve likelihood with real poses, as opposed to 
pseudo-inverse based algorithm. 

6 Conclusions 

In this work reconstruction techniques to estimate static hand poses from a reduced 
number of measures given by an input glove-based devices are presented. These tech- 
niques are based on classic optimization and applied optimal estimation methods. The 
main innovation relies on the exploitation of the a priori information embedded in the 
covariance structure of a set of grasp poses. This covariance individuates some coordi- 



nation patterns, defined as postural synergies, which reduce hand DoFs to be measured 
and controlled. 

Simulations results, where noise effects are also considered, and experiments with 
a low-cost sensing glove are reported. Performance is compared with the one obtained 
with a simple pseudo-inverse based algorithm. Statistical analyses demonstrate the 
effectiveness of the here proposed hand pose reconstructions. 

The achieved results can be useful to improve a large class of human-interfaces 
in many application fields, e.g. video-games or tele-robotics, where fine hand posi- 
tion individuation and low cost devices are crucial features to allow a reliable haptic 
experience. 

In (Bianchi et al., 2012a] we apply this reconstruction procedure to the measures 
provided by an optimally designed sensing glove. 
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